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Thia  material  haa  been  prepared  for  review  by  appropriate 
reaearch  or  military  agenciea,  or  to  record  reaearch  information 
on  an  interim  baaia. 

The  contenta  do  not  neceaaarily  reflect  the  official  opinion 
or  policy  of  either  the  Human  Reaonrcea  Reaearch  Office  or  the 
Department  of  the  Army. 


The  Human  Reaonrcea  Reaearch  Office  ia  a nongovernmental 
agency  of  The  George  Waahington  Univeraity,  operating  under 
contract  with  the  Department  of  the  Army  (DA  ^188>ARO>2). 
HumRRO’a  miaaion,  outlined  in  AR  70-8  ia  to  conduct  reaearch 
in  the  fielda  of  training,  motivation,  and  leaderahip. 
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>The  purpose  of  this  study  was  to  field  test  the  training  effectivness  of  the 
product  of  the  original  SDR  which  Is  designated  the  XM35  Conduct  of  Fire 
Trainer  (COFT).  The  present  study  design  permits  evaluation  of  the  COFT 
with  visual  missile  representation  Including  target  m1ss>d1stance  Indicator 
Information,  but  without  the  print-out  of  In-flight  tracking  performance  as 
feedback  to  the  gunner  and  the  Instructor. ^ 
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INTERIM  REPORT  OF  TRAINING  EFFECTIVENESS 
OF  XM35,  CONDUCT  OF  FIRE  TRAINER  (COFT^ 


A.  BACKGROUND 


Wltii  tbe  propoaal  of  the  Shlllela^  Weapons  System,  the  US  Army  Armor 


Sdiool,  in  1960,  stat^  a requirement  for  a trainer  ^wfaidi  would  allow  the  training 

•t 

of  gunners  on  missile  firing  skills,  hi  planning  for  training  effecdveness,  the 


military  characteristics  (written  in  1961)  outlined  that  a device  be  developed  vdiich 


would  present  a realistic  visual  representation  of  the  missile  so  that  the  gunner 


might  learn  to  respond  to  vdiat  he  saw  and  that  the  device  provide  performance  feed* 


back  which  mig^t  be  used  in  critiquing  the  gunner  by  his  instructor.  During  later 


planning  conferences,  it  was  suggested  that  the  device  be  so  engineered  that  the 


various  types  of  input  to  the  student  could  be  evaluated,  in  terms  of  training  effective 


of  the  product  of  the  original  SDR  wfaidi  is  designated  the  XM35  Conduct  of  Fire 


Trainer  (COFT).  The  present  study  design  permits  evaluation  of  the  COFT  with  all 


components  operating  and  of  the  COFT  with  visual  missile  representation  Including 


target  miss-distance  indicator  information,  but  without  the  print-out  of  in-flig^ 


on  either  the  full  COFT  system  or  the  modified  system  were  to  be  conqiared  as  missile 
gunners  with  students  trained  on  the  MSSl  vehicle  wifiiout  benefit  of  a training  device. 


The  military  characteristics  for  the  Shillelagh  Weapon  System  had  Indicated 
fiut  die  relatively  high  costs  ot  the  missile  would  preclude  actual  missile  firings  for 


? 
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training  purposes.  TTius  a missile  simulator  was  requested  as  a means  of  providing 
gunnery  training  with  the  missile  system.  Hie  simulator  was  to  be  mounted  on  the 
M-551  and  on  subsequent  vdiicles  designed  to  accept  the  Shillelagh  Missile  System, 

The  purpose  of  die  device  was  to  provide  missile  firing  eiqierience  during  ATT,  Armor 
training  and  later  Ihiit  proficiency  maintenance  training  without  requiring  the  eiqiendi- 
ture  of  actual  missiles.  ' 

Service  testing  of  the  prototype  and  preproduction  models  of  the  device,  by  the 
US  Army  Armor  and  Engineer  Board,  indicated  a relatively  large  number  of  durability 
and  reliability  deficiencies.  The  extent  of  these  deficiencies  precluded  a test  of  training 
effectiveness  before  further  device  modification.  USCONARC,  USAARENBD,  and  GDC 
therefore  recommended  a delay  in  commitments  for  device  procurement  until  die  major 
deficiencies  had  been  corrected  and  device  testing  could  be  completed. 

In  acting  on  this  recommendation,  DA  held  a conference  at  Fort  Knox  on  5 Jan 
’67  with  representatives  attending  from  DA  staff,  USCONARC,  USACDCARMA,  USA- 
ARENBD, USAARMS,  HumRRO,  USNTDC,  and  the  Project  Manager’s  Office/M551. 

The  conference  indicated  that  the  device,  in  its  present  configuration,  contained  a num- 
ber of  deficiencies  and  shortcomings  that  could,  and  would,  be  corrected  by  the  manu- 
facturer . Additional  testing  of  the  modified  device’s  reliability,  durability  and  training 
effectiveness  would  be  required  before  a valid  recommendation  concerning  acceptance 
or  rejection  could  be  made.  Based  on  this  information,  DA  deferred  an  AMC  request 
for  an  extension  of  a limited  productira  (LF)  type  classification  until  a thorough  evalua- 
tion could  lie  completed.  Such  an  evaluation  was  to  include  a retest  of  the  deficiencies 
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Isolated  on  the  earlier  models  and  a determination  of  the  training  and  cost  effectiveness 


of  the  device.  All  testing  was  to  be  completed  by  IS  Mar  *67 


Subsequent  to  the  conference,  an  AMC  agreement  extended  the  limited  production 


contract  for  procurement  of  the  COPT.  However,  this  agreement  stipulated  that  the 


contract  could  be  terpninated  if  the  further  testing  Indicated  that  the  device  was  unac 


ceptable 


To  accomplish  the  test  of  training  effectiveness,  a series  of  meetings  was  held 


between  representatives  of  HumRRO,  USAARBNBD,  USAARMS,  USACDCARMA, 


USATCA,  and  The  Armor  Center  G3.  During  these  meetings,  a basic  plan  of  test  out' 


lined  by  HumRRO  was  accepted  and  responsibilities  and  schedules  for  conduct  of  the 


test  were  established.  Appendix  A presents  the  basic  plan,  responsibilities,  and 


schedule 
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C.  METHOD 

1.  Subjects.  Enlisted  men  from  USATCA  and  from  the  16th  Armored  Group 
served  as  trainees.  It  was  required  that  they  had  "recently"  graduated  from  ATT, 

Armor  with  gunner  <|uallflcatlon  scores  on  TaUes  IV  and  V.  "Rjpcently"  was  defined 
as  "within  the  past  three  m<mths”  but  dils  latter  definition  was  not  stricdy  adhered  to. 

A pool  of  44  enlisted  men  were  assigned  fbr  Replication  I of  the  study.  Prom 
this  pool,  three  training  condition  groups  of  10  trainees  were  selected.  The  groups  were 
matched  on  GT,  gunnery  qualification  score,  and  time  scores  on  the  Marrietta  Apparatus 
Company  Two'Arm  Tracing  Apparatus.  (In  addition,  the  groups  were  balanced  on  Armed 
Forces  Vision  Tester  scores  for  uncorrecf'  * ,ix  and  near  visual  acuity-preferred  eye, 
far  and  near  visual  acuity- nonpreferred  eye^  far  and  near  vertical  {diorla,  and  far 
and  near  lateral  phoria.)  Due  to  delaj^  In  the  study,  8 replacements  were  later  assigned 
to  die  groups.  Later  trainee  losses  during  the  study  reduced  group  numbers  to  8,  9,  and 
0.  Ihe  average  scores  on  the  diree  matching  measures  for  diese  trainees  are  given  In 
Table  1..  ;:V;  ■ . ■ ' 
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j Average  Scores  on  Group  Matching  Measures 


Replication  I 

N 

GT 

Gunnery 

Qualification 

Two- Ainu 
Tracing 

Training  Confiition  I 

8 

96.4 

185.6 

171.1 

Training  Condition  II 

9 

98.1 

181.7 

157.9 

Training  Condition  m 

ao 

109.1 

186.3 

152.3 

Replication  II 

Training  Condition  I 

9 

95.8 

186.1 

128.2 

Training  Condition  II 

8 

103.1 

185.6 

122.2 

Training  Condition  in 

8 

97.2 

185.5 

128.9 

A pool  of  40  enlisted  men  were  assigned  for  Replication  II  of  the  study.  From 
this  pool,  three  training  condition  groups  of  12  trainees  were  selected.  Hiese  groups 
were  matched  as  in  Phase  I.  Later  trainee  losses  during  the  study  reduced  group 
numbers  to  9,  8,  and  8.  The  average  scores  on  the  three  matching  measures  for  these 
trainees  are  given  in  Table  1. 


During  the  course  of  the  study,  reductions  in  the  original  numbers  of  trainees 
assigned  to  the  groups  were  due  to  trainee  re-assignment  to  other  Units  or  to  OCS 
or,  in  one  case.  AWOL.  No  trainees  were  omitted  from  die  study  on  the  basis  of 
conduct  or  performance  in  the  study. 


2.  Conduct  of  Training.  Three  XM35  Conduct  of  Fire  Trainers  (COFT) 
mounted  on  M551  vehicles  and  one  XM35  target  device  mounted  on  an  M551  vehicle 


were  used.  For  each  of  the  two  replications  of  the  study,  each  of  the  three  groups 
of  trainees  was  assigned  to  a training  condition  as  follows: 


a.  Condition  1 (No 


L The  COFT  was  not  energized  during  any  of 


the  training  periods.  Instructor  critique  of  gunner  performance  was  based  mainly  on 
his  judgment  of  gunner  performance.  The  instructor  used  the  vane  sight  and  the 
azimuth  indicator  for  determining  azimuth  errors,  but  had  no  indication  of  elevation 


errors. 


b.  Condition  II  (COFT  minus  diart  recorder).  During  training,  all  COFT 


assemblies  excepting  the  chart  recorder  were  energized.  Instructor  critique  was  based  on 


judgment,  aided  by  the  vane  sig^t,  azimuth  indicator,  and  miss-distance  indicator. 


c.  Condition  lH  (COPT^t  During  training  all  COFT  assemblies  were  ener- 
gized. Instructor  critique  was  based  on  infoimiation  from  the  miss-distance  indicator 
and  the  chart  recorder  which  was  kept  in  the  AUTO  mode. 

All  training  w^  conducted  by  The  Armor  School,  as  shown  in  Table  2,  Training 
> was  to  be  conducted  over  8 days  ^ as  follows: 


^The  original  plan,  APPENDIX  A,  specified  10  training  days.  This  was  reduced 
due  to  scheduling  difficulties. 


Day  1.  nie  trainee  pool  was  divided  into  two  equal  groups.  During  the 
morning  one  group  reported  to  The  Armor  School  for  orienudon  and  turret  familiariza- 
tion training.  The  second  group  reported  to  the  US  Army  Human  Research  Unit  for 
pretesting.  During  lihe  afternoon  the  groups  were  reversed. 

The  Initial  orientation,  conducted  by  The  Armor  School,  was  aimed  primarily 
toward  an  explanation  of  the  test  and  an  introduction  to  the  Armored  Reconnaissance/ 
Airborne  Assault  Vehicle  M551.  During  this  orientation,  emphasis  was  placed  upon  all 
participants  knowing  the  "name  of  the  game"  and  acquiring  an  appreciation  of  the  conduct 
of  the  test.  General  characteristics,  capabilities  and  limitations  of  the  vdiicle  were 
explained;  the  ammunition  peculiar  to  the  gun/launcher  system  was  introduced,  and 
safety  measures  were  stressed.  At  the  conclusion  of  this  training,  an  orientation  film 
provided  by  the  Sheridan  Project  Manager*s  Office  (Film  Release  Number  12)  was  shown 
to  the  group. 

Following  the  film,  an  abbreviated  turret  familiarization  class  was  conducted. 

All  controls  and  locations  of  major  components  were  pointed  out  and  their  function 
explained.  Detailed  operation  of  the  breech,  recoil  systems  and  "G  and  C"  components 
were  eliminated.  Only  those  controls  necessary  to  successfully  track  a moving  target 
were  stressed.  In  the  interest  of  economy  of  time  and  accuracy,  all  zeroing,  alignment 
and  systems  checks  were  completed  by  NCO  instructors.  Emphasis  was  placed  upon 
the  gunner's  control  handle,  trim  controls,  diopter  setting,  filter  and  reticle  ligjit 
Intensity  control. 

After  all  pretesting  and  orientation  had  been  completed,  HumRRO  selected  the 
men  to  be  trained  and  assigned  them  to  the  three  training  conditions.  Selection  was 
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based  on  the  requirements  for  matching  the  three  groups  on  the  basis  of  the  General 
Technical  score  on  the  ACB,  gunnery  qualification  during  AIT,  Armor;  the  Marrietta 
Two- Arm  Tracer;  and  the  Armed  Forces  Vision  Tester. 

Day  2,  ^1  trainees  received  a review  of  the  gunnery  controls  and  prepara- 
tory training  in  control  manipulation  and  sighting.  Ihe  preparatory  training  consisted 
of  two  15-minute  periods  of  tracking  a moving  target;  one  period  in  the  morning  and  one 

• I 

period  in  the  afternoon.  The  target  vehicle  used  was  an  M551  vehicle  similar  to  that  ' 
used  as  a target  during  the  balance  of  the  test  program.  Range  to  the  target  and  speed 
of  the  target  were  varied  during  this  phase  of  training.  Introduction  of  the  fire  command 
to  engage  a target  with  a missile  was  introduced  at  this  time.  Accuracy  of  lay,  and 
smoothness  of  track  were  monitored  by  the  NCO  instructor  by  use  of  the  vane  sight  and 
the  azimuth  indicator. 

Pa3^  3-8.  During  this  period  each  trainee  received  three  hours  of  tracking 
and  firing  practice  under  the  experimental  conditions.  Training  was  conducted  on  the ' 
basis  of  1/2  hour  of  practice  per  trainee  per  day:  IS  minutes  in  the  morning  and  IS 
minutes  in  the  afternoon.  To  obtain  equal  target,  weather  and  lighting  influences  between 
groups,  die  three  M551  launcher  v^cles  were  parked  side-by-side  with  one  trainee 
for  eadi  condition  practicing  concurrently. 

'Ihe  target  v^ide  traversed  a "cross-country"  tank  path  perpendicular  to 
the  line  of  sight  of  die  laundier  vdilcles.  The  target  course  was  right'to-left  and  left- 
to-rlght  at  an  average  speed  of  ISmi^i.  No  evasive  action  could  be  undertaken. 

During  practice  the  instructor-vehicle  commander  issued  die  fire  commands 
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and  critiqued  die  trainee  after  each  firiiig  based  on  the  data  provided  by  the  condition 
Instrumentation. 

As  shown  in  Table  2,  numerous  factors  modified  the  planned  conduct  of 
training.  The  major  modification  was  due  to  a priority  need  for^the  launcher  vdiicles. 
This  resulted  in  a nlnh-day  delay  between  the  third  and  fourth  training  days  of  Replica- 

i 

tlon  I.  During  the  delay  eig^t  trainees  were  reassigned.  Ihelr  replacements  were 

trained  under  a compressed  schedule  for  Days  1-5.  Six  replacements  completed  the 

. 1 

study:  three  in  Condition  H and  three  in  Condition  m. 

A second  modification  of  the  plan  was  due  to  range  facilities.  It  had  been 
planned  to  run  tracking  trials  consisting  of  a series  of  three  consecutive  target  distances: 
long,  medium,  and  short.  Target  facilities  restricted  target  v^icle  nms  to  one  course 
with  a minimum  and  maximum  distance  specified  by  the  point  directly  in  front  of  the 
launcher  vehicles  and  at  the  end  of  the  course  respectively.  Range  availability  forced 
target  distances  to  vary  over  training  days  with  a preponderance  of  short- medium  dis- 


tances. 


A third  factor  was  weather  and  equipment  failures  that  caused  a few  one-day 


delays  in  the  schedule.  In  addition,  equipment  malfunctions  in  both  vehicle  and  trainer, 
limited  available  laundier  vehicles  to  two  during  the  final  part  of  Replication  I and  all 
of  Replication  n.  Malfunctions  occurring  during  a training  day  are  not  noted  in  Table 
2,  but  were  frequent  during  Replication  I and  were  evident  on  one  day  during  Replication 
n.  In  all  cases,  training  was  conducted,  or  continued,  for  the  affected  conditions,  by 
training  the  groups  in  sequence. 


12 


f! 

lit 


i'l: 


3.  Trainer  Teats.  At  the  conclusion  of  each  day's  training,  each  trainee 
received  four  firing  runs  which  were  recorded  on  the  chart  recorder.  All  other 
trainer  instrumentation  was  kept  consistent  with  the  training  conditions.  A HumRRO 
assistant  monitored  tiie  records  for  Conditions  I and  n so  that  the  Instructor  did  not 
see  the  chart  and,  therefore,  would  not  be  tempted  to  provide  unplanned  feedback. 

Training  for  both  replications  was  concluded  on  a Saturday.  On  the  follow- 
ing Monday,  all  available  trainees  who  were  not  selected  to  fire  the  missile  returned  to 
the  range.  Each  trainee  received  one  dry-run  trial  for  control  familiarization  and  two 
recorded  simulated  fixings  with  full  missile  simulation.  These  trials  constituted  a non- 
flrlng  performance  proficiency  test. 

For  all  COPT  records  a hit-miss  analysis  was  made  based  on  the  missile 
flight  path  to  a 7. 5 X 7. 5 foot  target.  In  addition,  the  maximum  allowable  DOWN  error 
from  the  center  of  the  target  was  set  at  2. 5 feet.  Missile  error  greater  than  this  in  the 
DOWN  direction  might  result  in  groimding.  Ihus  the  hit  criteria  required  no  more 
than  3.75  feet  LEFT,  RIGHT,  or  UP  error  at  time  of  missile  impact  on  the  target  and 
no  more  than  2.5  feet  DOWN  error  at  any  time  during  tb?  missile  flight. 

4.  Missile  Firings.  At  the  conclusion  of  training,  the  "best"  three  trainees  in 
each  training  condition  were  selected  by  HumRRO  on  the  basis  of  the  daily  COFT  test 
records.  Each  trainee  fired  two  missiles;  the  fbrst  at  a long  range  target  and  the  second 
at  a medium  range  target. 

All  targets  were  7.5  x 7.5  foot  panels  traveling  a straight,  level  course 
perpendicular  to  the  llne*of«lght  of  the  launcher  vehicle.  Average  target  speed  was 
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15  mph.  Before  each  firing  the  trainee  received  two  target  rune,  each  rlght-to-left: 
and  then  left-to-rl^t,  for  control  familiarization.  The  trainee  then  fired  the  missile 
during  the  next  rlght-to-left  run. 

Firings  Ayere  to  be  conducted  during  three  consecutive  days  following  the 

I 

completion  of  training  for  each  replication.  During  each  day,  one  trainee  from  each 
training  condition  was  to  fire  with  the  following  order  of  conditions  within  days: 
Replication  I — 1,  2,  3 — 2,  3,  1 — 3,  1,  2 
Replication  II  — 3,  2,  1 — 2,  1,  3 — 1,  3,  2 

Because  of  severe  weather  conditions,  the  firing  days  were  ^langed  as 
shown  in  Table  3.  However,  the  plaimed  order  of  firings  was  maintained. 


Talde  3.  Missile  Firing  Dates 


Training  Condition 

Long  Range 

Medium  Range 

I 

20  Feb 

27  Fet^ 

n 

22  Feb 

27  Feb 

ni 

22  Feb 

27  Feb 

n 

23  Feb 

27  Feb 

m 

23  Feb 

27  Feb 

I 

23  Feb 

27  Feb 

m 

3 Mar 

3 Mar 

I 

3 Mar 

3 Mar 

n 

3 Mar 

3 Mar 

m 

7 Mar 

7 Mar 

n 

7 Mar 

7 Mar 

I 

7 Mar 

7 Mar 

n 

8 Mar* 

8 Mar 

I 

8 Mar* 

8 Mar 

m 

8 Mar* 

8 Mar 

I 

8 Mar 

8 Mar 

m 

8 Mar 

8 Mar 

n 

8 Mar 

8 Mar 

*These  fixings  were  omitted  from  the  analyses  due  to  one  known  and 
two  suspected  missile  system  failures . 
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Again,  hit- miss  data  were  used  as  the  performance  criteria.  Ihis  data 
was  provided  by  spotters  and  surveys  of  the  target  panel. 

During  Replication  n,  a series  of  three  long  range  firings  was  degraded 
by  one  known  and  two  suspected  missile  system  failures.  This  series,  one  missile  from 
each  training  condition,  was  omitted  from  the  analysis. 


D.  RESULTS  AND  DISCUSSION 


1.  Missile  Firings.  The  primary  criteria  for  comparison  of  the  training  condi- 
tions was  hit- miss  data  during  the  actual  missile  firings.  Figure  1 shows  the  average 
proficiency  levels  for  the  six  missile  firers  in  each  condition  during  training.  Since 
the  training  test  conditions  varied  (i.e. . no  missile  simulation  during  training  for 
Condition  I),  no  direct  comparison  can  be  made  between  groups.  However,  it  can  be 
noted  that  all  groups  seem  to  have  reached  a hi£^  level  of  proficiency  by  the  completion 
of  training. 


HOURS  OF  TRAINING  IITH  STUOY  CONDITIONS 


fig  1.  MISSILE  FIBERS  HIT-MISS  AVERAGES  DURING 

TRAINING 


The  total  number  of  target  hits  for  each  training  condition  at  each  target  range 
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is  shown  In  Table  4.  For  comparison  over  training  conditions  and  ranges,  the  data 
have  also  been  converted  to  percentages.  Tlie  percentages  indicate  tbat  the  Condition 
in  (COFT^  trainees  performed  at  a relatively  high  level  at  botili  tilrget  ranges.  But  the 
performance  of  die  Condition  I (No  COFT)  and  Condition  H (COFT  minus  recorder) 
trainees  tended  to  be  poorer  at  the  longer  range.  Over- all  the  Condition  m trainees 
performed  best.  Condition  I next  best,  and  Condition  n poorest. 
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Table  4 


Long  Range  (N  ■ 5)* 

Mid  Range  (N  = 6) 

Number  of  Hits 
’ — •' 

> 

Total  (N  = Jl) 

Condition  I 

2 

4 

6 

Condition  II 

0 

3 

3 

Condition  m 

4 

5 

9 

Percentage  of  Hits 

Mean 

Condition  I 

40 

66 

54 

Condition  II 

0 

50 

27 

Condition  m 

80 

83 

82 

"'Omitting  one  long-range  firing  from  each  Condition  due  to  known  and  suspected 
missile  system  failures . 
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A statistical  test  of  the  differences  (C!ochran  Q test;  Siegel,  1956)  was  calculated 
separately  for  the  long-range  and  medium-range  firings.  The  difference  between 
Condition  m and  Condition  II  fdr  long-range  firings  was  rellable. ' No  other  differences 
between  the  groups  were  reliable.  It  would  appear  dien  that  missile  simulation  with  the 
chart  recorder  provided  some  aspect  of  training  that  transferred  to  the  actual  missile 
firings;  and  that  this  aspect  could  not  be  obtained  by  simple  tracking  practice.  What  . 
dlls  aspect  is  cannot  be  definitely  determined  from  the  rather  sparse  data  available. 

A review  of  the  over-all  results  indicates  that  missile  simulation  may  provide  the 
eiqperlence  in  coping  with  obscuration  and  missile  flare  effects  that  is  otherwise  pro- 
vided by  the  first  actual  missile  firing.  Also,  diat  the  permanent  record  during  gunnery 
training  may  increase  gunner  proficiency  in  smooth  tracking  and  the  control  of  die 
missile  that  Is  required  to  a greater  degree  when  firing  at  long-range  targets. 

2.  End-Of- Training  COFT  Tests.  A secondary  criterion  for  comparing  training 
conditions  was  provided  by  die  two  simulated  firings  after  the  completion  of  training. 
Hiese  test  firings  were  conducted  for  all  trainees  ^o  had  not  been  selected  to  fire 
missiles  (one  trainee  was  lost  due  to  reassignment  immediately  alter  the  completion 
of  training).  On  all  firings  there  was  complete  simulation  of  missile  effects.  Unfor* 

I 

tunately,  all  firings  had  to  be  conducted  at  a short  range. 

Figure  2 shows  the  average  proficiency  levels  for  the  nonfirers  in  each 
condition  during  training  and  on  the  post-training  tests.  Again,  no  valid  statistical 
comparison  can  be  made  between  the  groups  but  there  seems  to  be  only  slight  differences 

^The  .OS  lord  of  statistical  reliability  Was  established  as  acceptable  for  all 
analyses  in  this  stodjr. 
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PER  GENT  HITS-DOWNS 


FIG  2.  NON-FIRERS  HIT-MISS  AVERAGES  DURING 
TRAINING  AND  POST-TRAINING  COFT  TEST. 


at  the  completion  of  training. 

All  groups  evidence  some  loss  on  the  final  test  firings . This  is  probably  due 
to  the  lack  of  sufficient  warm-up  practice:  one  target  run  before  the  final  test  firings 
as  compared  to  15  ntin.  of  practice  before  the  daily  tests.  Statiftical  tests  of  the 
differences  on  each  post-training  firing  (Cochran  Q test;  Siegel,  1956)  indicated  no 
significant  differences  between  the  training  condition  groups. 
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3.  Summary  of  Post- Training  Tests.  Both  the  missile  firings  and  simulated 
firings  at  short  and  medium  range  targets  indicated  that,  when  fairly  higji  levels  of 
tracking  proficiency  have  been  attained,  there  is  little  degradation  in  performance 
due  to  the  introduction  of  obscuration  and  missile  flare  effects.  fThis  finding  corre- 
sponds with  earlier  studies  using  more  grossly  simulated  conditions  (Haggard,  1966). 

For  the  long-range  missile  firings  (there  were  no  long-range  simulated 
firings),  the  results  are  not  as  clear  cut.  The  rank-order  of  the  groups  is  Condition 
m best.  Condition  I next,  and  Condition  II  poorest.  In  terms  of  hit  percentage  these 
differences  appear  large:  80,  40,  and  0 per  cent  respectively.  However,  the  statistical 
analysis  of  the  number  of  hits  was  not  significant  with  the  exception  of  the  extremes. 

In  part,  this  may  be  due  to  the  large  difference  that  is  required  with  such  a small 
number  of  missiles.  Extreme  effects  would  be  required  and  these  effects  might  not  be 
expected  to  be  evidenced  at  the  end  of  so  extensive  a training  period.  While  no  conclusive 
answer  can  be  given  it  appears  as  though  the  COFT  may  provide  a higher  level  of  smooth 
tracking  proficiency,  and  this  difference  is  evidenced  in  better  missile  control  after 
obscuration  clears  and,  therefore,  higher  hit  probability  at  the  longer  ranges.  The 
present  COFT  study  does  not  provide  the  data  to  check  this  assumption  but  some  indi- 
cation can  be  obtained  from  the  recorded  in-training  tests  discussed  next. 

4.  In- Training  COFT  Tests.  The  data  from  the  in-training  tests  provide  some 
Information  pertinent  to  the  post-firing  results.  The  purpose  of  these  tests  was  to 
provide  learning  curve  information  that  would  aid  in  planning  training  time  for  the 
method  selected.  Test  trials  were  therefore  run  under  the  same  conditions  as  training. 
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No  direct  comparison  was  intended  between  the  curves  since  the  firing  conditions  for 
Training  Conditions  II  and  in  included  obscuration  and  missile  flare  effects.  These 
effects  were  thought  to  make  the  task  more  difficult  than  for  Condition  I.  Ihus.  except 
for  the  effects  of  feedback  provided  by  the  missed  distance  indicator  and/or  the  chart 
recorder.  Conditions  H and  HE  were  expected  to  perform  at  a lower  level  during 
training  than  would  Condition  I. 


For  eadi  trainee  the  percent  hits  was  calculated  for  the  four  firings  adminis- 
tered at  the  completion  of  each  day  of  training.  The  average  for  each  group  is  by  days 
(1/2  hour  of  training  practice  per  day)  in  Figure  3.  The  curves  are  plotted  separately 
by  replication  because  no  records  were  available  for  the  first  training  day  of  Replication 
I^  and  the  records  for  the  second  day  (1  hr.  of  training  practice)  are  extremely  incon- 
sistent for  Conditions  I and  II  between  replications.  The  remainder  of  the  curves  are 
fairly  consistent  between  replications. 
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The  curves  in  Pig.  3 indicate  three  major  points.  (1)  Despite  expectations 


the  miss  distance  indicator  seemed  to  provide  enough  information  for  immediate  gunner 


critique  to  overcome  the  presumed  degrading  effects  of  obscuration  and  missile  flare 


Further,  the  additloq  of  the  chart  recorder  added  enough  information  to  bring  the 


trainees  to  an  even  higher  level  of  proficiency  in  a shorter  time  period  than  either  of 


the  other  two  conditions.  (2)  All  groups  have  reached  a fairly  high  level  of  proficiency 


on  the  shorter  range  targets  by  the  end  of  the  three  hours  of  training  practice.  (3) 


With  practice  on  only  short-range  targets,  Condition  m trainees  were  able  to  demon- 


strate a fairly  high  level  of  proficiency  on  long-raxige  targets.  Conditions  I and  n 


trainees  did  not  demonstrate  high  proficiency  on  long-range  targets 


The  statistical  analysis  (Lindquist  Type  I,  1953)  of  the  differences  (indicated 


in  Figure  3)  is  summarized  in  Tables  S and  6.  As  shown,  there  is  a significant  inter 


action  between  training  days  and  training  conditions.  For  this  reason  Newman- Keuls 


subanalyses  (Winer,  1962)  were  computed  for  the  differences  within  each  condition  and 


within  each  day  for  each  replication 


Table  8 

Summary  Analysis  of  Variance  of  the  Percent  Hits  for  Replication  1 During  Training 


Source 

df 

Mean  Square 

F 

P 

Training  Conditions 

2 

8885.88 

18.13 

<7oi 

il 

Error  Between  Conditions 

24 

490.22 

■ 

Training  Days 

4 

5724.54 

10.69 

<•.01 

Days  X Conditions 

8 

1932.18 

3.61 

<'.01 

Error  Within  Conditions 

96 

535.36 

3 

Total 

CO 

*; 

li 

Table  6 

" 

* 

3 

0 

Summary  Analysis  of  Variance  of  the  Percent  Hits  for  Replication  2 During  Training 

ii 

Source 

df 

Mean  Square 

F 

P 

Training  Conditions 

2 

• 3102.22 

3.55 

<’.05 

Error  Between  Conditions 

22 

874.04 

Training  Days 

5 

13736.67 

26.88 

c.oi 

Days  X Conditions 

10 

2635.28 

5.16 

<.01 

Error  Wltiiln  Conditions 

110 

511.03 

V 

Total 

149 

i V'l 
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The  results  of  these  analyse  are  summarized  in  Tables  7-10  presented  in 
Appendix  B.  These  analyses  support  the  three  points  noted  above.  (1)  The  trainees 
in  Condition  II  do  at  least  as  well  as  those  In  Condition  I and  Condition  LH  performs 
at  a significantly  hi^er  level  t-lmn  either  of  the  other  two  groups  (Tables  9 and  10) . 
(2)  Condition  III  trainees  attain  a relativ^y  high  degree  of  proficiency  during  the 
first  1/2  hour  of  training  while  the  other  trainees  need  a greater  amount  of  train* 
ing  to  reach  this  level  (Tables  7-10).  (3)  The  trainees  in  Conditions  I and  U 
tend  to  show  a significant  drop  in  proficiency  when  transferred  to  long  range  tar- 
gets while  those  in  Condition  in  show  little  effect  (Tables  7 and  8). 
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B.  IMPLICATIONS 
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While  each  of  the  criterion  measures  (missile  firings,  post-training  COPT 
tests,  and  in-training  COPT  tests)  provides  only  partial  Information  with  respect 
to  the  problem;  taken  together,  and  considering  previous  related  studies  (e.g., 
Haggard  1966),  there  do  seem  to  be  some  fairly  clear  implications  for  training: 

1 . Gunner  proficiency  required  in  missile  firing  at  a moving  target  must 
be  considered  as  a sequence  of  skills  varying  not  only  in  type  but  also  in  the  qual- 
' Ity  required.  This  sequence,  shown  in  the  following  diagram,  consists  of  (1)  the 
relatively  gross  track  that  must  be  established  before  firing,  (2)  firing  the 
weapon,  (3)  retalniiy  the  established  traddag  rate  and  direction  during  d)scura- 
don,  (4)  adjustment  after  obscuration  to  eorroet  for  target  direcdonal  change 
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and  accumulated  error  in  the  initial  tracking  rate,  and,  finally,  (5)  eatab- 
llahlng  a amooth  and  conalatent  rata  until  mlaalla  Impact  on  target.  Prom 


INPUT  TO  eONNER 


OMCUIIATIM 


ERwOff 


•rasa  Traaklag 


riM 


M}« 


•■aatk,  Caaaiataak  Traaklag 


OINMER  OUTPUT 


0 

D 


e 

D 


0 

01 


thla  diagram  we  can  define  two  tracking  requlrementa . The  firat  requirement  la 
the  eatahUahment  of  an  Initial  and  generally  cwalatent  rate  of  tracking  before  firing 
and  maintenance  of  thla  rate  and  groaa  degree  of  conalatency  during  (^curatlon 
- and  until  dlacrepanclea  between  llne-of>alght  and  target  are  noted . Aa  aoon  aa 
dlacrepanclea  are  (Served,  the  gunner  muat  make  an  Immediate  adjuatment  and 
continue  to  track.  With  the  relatively  long  perloda  of  obacuratlon  reaulting  from 
firing  the  Shillelagh  mlaalle  and  the  one  to  two  aecond  reaction  time  required  for 
^ relaying,  thla  aegment  of  the  taak  would  appear  to  encompaaa  the  requlrementa  for 
" engaging  abort  range  targeta . 

The  aecoml  requirement  occura  after  the  poat-obacuratlon  adjuatment  or  re-lay. 
From  thla  point  on,  the  gunner  muat  maintain  the  appropriate  rate  of  track  and  he 
moat  become  Increaaln^y  conalatent  la  maintenance  of  the  rate . Thla  la  a finer 
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d^ee  of  trackiiig  consistency  dian  that  i^ch  Is  required  in  the  first  segment. 
The  time  period  fqr  which  this  smoodi  treddi^  muet  be  melntalned  depends  upon 
the  distance  to  the  ^zget.  The  allowable  fluctuations  in  this  tracking  depend  upon 
die  visual  an^e  to  the  target,  i.e.,  apparent  target  size  vdilch  becomes  smaller 
with  Increasing  target  distance.  Thus  as  we  increase  target  rai^  we  also 


increase  the  requirement  for  fine  tracking  skill  and  for  dds  consistency  over 
long  time  periods. 


With  respect  to  this  study,  one  could  expect  gunner  performence  on  the  short 
range  urgets,  during  either  firing  or  training,  to  Indicate  the  gross  proficiency 
levd  required  in  the  first  segment  of  the  task.  Beyond  this  requirement,  per* 
formance  on  the  long,  range  target^  during  firing  and  traintiy,  would  Indicate 
proficiency  in  fine  tracking. 


2.  When  gunner  proficiency  is  at  a fairly  hlj^  level,  as  at  the  conclusion  of  die 


study  training  program,  die  introduction  of  obscuration  and  missile  flare  effects 


t does  not  signlficandy  degrade  missile  firing  accuracy . Ihis  is  based  on  the  results 
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of  the  short -medium  range  missile' and  CX)PT  test  firings  during  which  these  effects 
are  assumed  to  be  most  relevant . However,  tihese  results  do  indicate  a small  but 
consistent  decrease  in  such  performance  which  might  be  attributable  to  introduction 
of  these  effects.  Considering  the  supply  and  cost  of  actual  missiles,  simulation  of 
these  effects  during  training  might  still  be  Justified. 

3.  High  levels  of  gunnery  proficiency  achieved  during  training  using  short- 
medium  range  targets  does  not  transfer  to  long  range  targets  unless  the  additional 
requirements  for  long  range  targets,  assumed  to  be  fine  tracking,  are  stressed 
during  training.  The  error  record,  here  the  chart  recorder,  seems  to  provide 
assistance  in  meeting  these  requirements . This  is  based  on  the  results  of  the  long 
range  missile  firings  and  in -training  COFT  tests . 

4 . The  error  readings  from  the  chart  recorder  also  seem  to  provide  feed- 
back that  greatly  Increases  the  rate  of  proficiency  gain  during  training,  thereby 
significantly  decreasing  the  amount  of  training  time  required  to  attain  any  stated 
level  of  proficiency. 

5.  Since  the  miss -distance  indicator  includes  system  error  plus  gunner 
tracking  error,  the  compounded  information  may  be  misleading  to  the  instructor . 
This  would  account  for  the  poor  performance  of  Condition  II  trainees  who  had  only 
this  feedback.  If  this  information  is  necessary  to  the  development  of  gunner  confi- 
dence in  the  system,  it  should  be  introduced  with  the  supplementation  of  an  accurate 


tracking  error  record  or  during  the  final  stages  of  training,  as  transition  to  the 
missile  firing  sltuatlOB. 


32 


REFERENCES 


Siegel,  S.  Nonparametric  statistics  for  the  behavioral  sciences,  McGraw-Hill 
Book  Co.,  New  York,  1956. 

Haggard,  D.  F.  iShillelagh  guidance  requirements  and  gunner  tracking  proficiency  (C), 
Draft  Technical  Report,  HumRRO  Division  2,  Ft.  Knox7  Ky.,  July  1966. 

Lindquist,  E.  F.  Design  and  analysis  of  experiments  in  psychology  and  educaticm, 
Houghton  Mifflin,  Boston,  1953 . • 

Winer,  B.  J.  Statistical  principles  in  experimental  design,  McGraw-Hill  Book  Co., 


New  York,  1962. 


APPENDIX  A 


Draft  Plan  for  Study  of  die  Training  Effectiveness  of  Cor?ponents  of  the  Conduct  of 
Fire  Trainer  XM35» 

/ 

Assumptions 

1 . That  the  functions  of  the  CFT  are:  (a)  to  provide  special  visual  effects  that 
will  be  encountered  by  the  gunner  when  firing  die  missile,  e.g.,  missile  flare  and 
obscuration,  and  (b)  to  provide  a permanent  continuous  record  of  gunner  performance 
during  the  missile  flight  for  in  flight  and  post-flight  gunner  critique,  and  (c)  to  pro- 
vide accurate  target  range  Information  for  missile  flight  time  and  hit -miss  feedback. 

2.  That  the  CFT  provides  each  of  these  functions  diroug^  the  use  of  separable 
components,  i.e.,  visual  effects  by  the  scope  and  visual  effects  simulator,  continuous 
record  by  one  target  bulb  and  chart  recorder,  and  target  range  by  the  two  target  bulbs. 

3.  That  utilization  will  consist  of  approximately  15-30  minutes  of  simulated 
range  firing  practice  per  trainee  during  ATT,  Armor  and  furdier  acquisition  and 
retention  practice  as  programmed  during  BUT  and  AUT. 

4.  That  presendy  programmed  service  tests  <pS  Army  Armor  Board  and  US 
Army  Armor  School)  will  adequately  determine  the  training  effectiveness  of  the  com- 
plete CFT  system. 

5.  That  if  effective  (4  above),  training  efficiency  mig^t  be  further  enhanced  if 
some  functions  of  die  CFT  were  accomplished,  at  less  cost  and  complexity.  And  that 
such  simplification  might  be  possible  without  a corresponding  reduction  in  training 


effectiveness 


6.  That  the  telescope  and  visual  effects  simulator  may  be  considered  to  be  in 
its  simplest  form  at  present  and  necessary  for  training.  But  that  the  functions  of  the 
recording  system  might  be  effectively  accomplished  by  a boresighted  telescope  for 
instructor  monitoring  and  the  function  of  the  target  range  equipment  by  an  estimated 
range  fed  through  a timer  by  the  instructor . 

Method 

Generally  the  study  will  consist  of  three  groups  of  trainees  receiving  simulated 
range  firing  practice  using  various  components  of  the  CFT.  Group  I will  receive 
practice  using  the  complete  CFT  system;  Group  II  using  the  visual  effects,  recorder, 
and  range  timer;  and  Group  III  using  the  visual  effects,  range  timer,  and  monitor 
telescope . 

Trainees  will  be  randomly  selected  from  ATT  trainees  who  have  completed 
gunnery  training  but  have  not  fired  the  gunnery  tables . ITiis  corresponds  to  plans 

' t 

for  integrating  Sheridan -Shillelagh  training  into  the  present  AIT  program. 

Each  trainee  will  receive  4 hours  of  simulated  range  firing  practice . Target 
range  conditions  will  be  specified  by  GDC,  Armor  Agency.  Training  will  be  given 
to  a minimum  of  three  trainees  per  period  to  balance  training  conditions  with  peculiar 
range  and  target  conditions.  Approximately  20  trainees  wUl  constitute  each  group. 

The  performance  criteria  will  be  tracking  consistency  and  hit -miss  as  provided  by 
the  complete  CFT  system . Performance  will  be  measured  at  the  completion  of  each 
1/2  hour  of  practice.  Tests  will  involve  the  minimum  number  of  trials  required  to 
obtain  a reliable  measure  without  providing  significant  proficiency  increases . No 
feedback  to  the  trainees  will  be  provided.  The  chart  records  will  be  used  for  analysis. 
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C3onduct-of-Fire  Trainer  Evaluation  Plan 


Systems 

Veh.  Only 

CFT-Recorder 

CFT  (FS) 

Students 

20  AIT  Grad 

20  AIT  Grad 

20  ATT  Grad 

Orientation 

Film 

Yes 

Yes 

Yes 

Trainer  Time 

4 Hrs 

4 Hrs 

4 Hrs 

Feedback 

TC 

TC 

Recorder 

Criterion 

Hits 

Hits 

Hits 

Training 

Evaluation 

Every  30  Min 
of  Training 

Every  30  Min 
of  Training 

Every  30  Min 
of  Training 

Test 

Best  6 Fire 
Two  Missiles 

Best  6 Fire 
Two  Missiles 

Best  6 Fire 
Two  Missiles 

Alternate 

Test 

Three  Target 
Passes  on  CFT 

Three  Target 
Passes  on  CFT 

Three  Target 
Passes  on  CFT 

Proposed  Responsibilities  and  Schedule 

TARMS  Provide  CF  Trainers 

Procure  Ranges  and  Set-up  Targets 
Supervise  Training 
Prepare  Report  of  Test 


Armor  and  Eng.  Bd. 
HumRRO 

CDC,  Armor  Agency 
Schedule 


Modify  Trainers,  as  Required 
Provide  Missiles  (36) 

Supervise  Firing  ' 

Procure  and  Pretest  Students  (TARMC) 
Assist  in  Training 
Analyze  Results 

Monitor  Training 
Monitor  Testing 

Train  and  Test  Ten  Students  for  Each 

Group  for  1-14  February 

Train  and  Test  Ten  Students  for  Each 

Group  for  15-28  February 

Final  Report  14  March 


Ti^LE  7 

NewBan-Reula  Analyses  Within  Conditions  During  Bapllcatlon  1 Training 

Condition  I 


Training  Day  and  Average 


2 

3 

4 

5 

6 

37.50 

43.75 

56.25 

68.75 

100.00 

2 

6.25 

18.75* 

31.25** 

62.50** 

3 

12.50 

25.00** 

56.25** 

4 

12.50 

43.75** 

5 

31.25** 

Condition  II 

Training  Day  and  Average 

3 4 2 

5 

6 

30.56  50.00  58.33 

66.67 

83.33 

3 

19.44**  27.77** 

36.11** 

52.77** 

4 

- 8.33 

16.68* 

33.33** 

2 

8.34 

25.00** 

5 

16.66* 

Condition  III 

Training  Day  and  Average 

2 5 3 

72.50  75.00  80.00 

4 

87.50 

6 

100.00 

2 

2.50 

7.50 

15.00 

27.50** 

5 

5.00 

12.50 

25.00** 

3 

/ 

7.50 

20.00** 

4 

1 

12.50* 

* designates  p ^ .05 

**  designates  p < .01 
for  all  tables 


TABLE  8 

Newman-Keuls  Analyses  Within  Conditions  During  Replication  2 Training 

Condition  I 

Training  Day  and  Average 

3 1 4 5 6 2 

13.89  30.56  30.56  72.22  77.78  88.89 


1 

15.62 


1 

56.25 


1 

4 

5 

6 

2 

30.56 

30.56 

72.22 

77.78 

88.89 

16.67* 

16.67* 

58.33** 

63.89** 

75.00** 

0 

41.66** 

47.22** 

58.33** 

41.66** 

47.22** 

58.33** 

5.56 

16.67** 

11.11 

Condition  II 
Training  Day  and  Average 


4 

37.50 


3 

50.00 


21.88**  34.38** 

12.50 


6 

90.62 

75.00** 

53.12** 

40.62** 


2 

93.75 

78.13** 

56.25** 

43.75** 

3.13 


Condition  III 
Training  Day  and  Average 


5 

93.75 

78.13** 

56.25** 

43.75** 

3.13 

0 


3 

2 

5 

4 

6 

59.38 

62.50 

65.62 

68.75 

90.62 

3.13 

6.25 

9.37 

12.50 

34.37** 

3.12 

6.24 

9.37 

31.24** 

3.12 

6.25 

28.12** 

3.13 

25.00** 

21.87* 

0| 

D 

a 

D 

,a 

I 

!' 

o] 

Oj 

[j[| 

iJi 


B-2 


■•MUiHbMila  Anal7«M  Within  Days  During  RnpUentlon  1 Training 


Training  Condition  and  Averaga 


Training  Condition  and  Average 


Training  Condition  and  Average 


Training  Condition  and  Averaga 


Nothing  Significant 


Training  Condition  and  Averaga 


